The Distributed Dual Ascent Algorithm is Robust to Asynchrony
نویسندگان
چکیده
The distributed dual ascent is an established algorithm to solve strongly convex multi-agent optimization problems with separable cost functions, in the presence of coupling constraints. In this letter, we study its asynchronous counterpart. Specifically, assume that each agent only relies on outdated information received from some neighbors. Differently existing randomized and block-coordinate schemes, show convergence under heterogeneous delays, communication update frequencies. Consequently, our can be implemented without requiring any coordination between agents.
منابع مشابه
Communication-Efficient Distributed Dual Coordinate Ascent
Communication remains the most significant bottleneck in the performance of distributed optimization algorithms for large-scale machine learning. In this paper, we propose a communication-efficient framework, COCOA, that uses local computation in a primal-dual setting to dramatically reduce the amount of necessary communication. We provide a strong convergence rate analysis for this class of al...
متن کاملAnalysis of Distributed Stochastic Dual Coordinate Ascent
In (Yang, 2013), the author presented distributed stochastic dual coordinate ascent (DisDCA) algorithms for solving large-scale regularized loss minimization. Extraordinary performances have been observed and reported for the well-motivated updates, as referred to the practical updates, compared to the naive updates. However, no serious analysis has been provided to understand the updates and t...
متن کاملDistributed Asynchronous Dual-Free Stochastic Dual Coordinate Ascent
In this paper, we propose a new Distributed Asynchronous Dual-Free Coordinate Ascent method (dis-dfSDCA), and prove that it has linear convergence rate in convex case. Stochastic Dual Coordinate Ascent (SDCA) is a popular method in solving regularized convex loss minimization problems. Dual-Free Stochastic Dual Coordinate Ascent (dfSDCA) method is a variation of SDCA, and can be applied to a mo...
متن کاملImproving Lower Bounds for the Quadratic Assignment Problem by applying a Distributed Dual Ascent Algorithm
The application of the Reformulation Linearization Technique (RLT) to the Quadratic Assignment Problem (QAP) leads to a tight linear relaxation with huge dimensions that is hard to solve. Previous works found in the literature show that these relaxations combined with branch-and-bound algorithms belong to the state-of-the-art of exact methods for the QAP. For the level 3 RLT (RLT3), using this ...
متن کاملDesign and Implementation of a Distributed Dual Ascent Algorithm for the Steiner Problem in Graphs
The Steiner Problem in Graphs (SPG) is defined as follows. Given an undirected graph G = (V,E), positive edge costs c and a set T ⊆ V of terminal nodes, find a connected subgraph (V ′, E′) of G with T ⊆ V ′ minimizing ∑ e∈E′ ce. In other words, find a minimum cost tree containing all terminals, possibly also containing some other nodes. The Steiner Problem in Directed Graphs (SPDG) is the case ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Control Systems Letters
سال: 2022
ISSN: ['2475-1456']
DOI: https://doi.org/10.1109/lcsys.2021.3084883